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Abstract 


Recently, a new type of set, named as random permutation set (RPS), 
is proposed by considering all the permutations of elements in a cer- 
tain set. For measuring the uncertainty of RPS, the entropy of RPS 
= is presented. However, the maximum entropy principle of RPS entropy 
has not been discussed. To address this issue, in this paper, the 
maximum entropy of RPS is presented. The analytical solution for 
maximum entropy of RPS and its corresponding PMF condition are 
respectively proofed and discussed. Numerical examples are used to 
illustrate the maximum entropy RPS. The results show that the max- 
imum entropy RPS is compatible with the maximum Deng entropy 
and the maximum Shannon entropy. When the order of the element 
in the permutation event is ignored, the maximum entropy of RPS 
will degenerate into the maximum Deng entropy. When each permu- 
tation event is limited to containing just one element, the maximum 
entropy of RPS will degenerate into the maximum Shannon entropy. 
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1 Introduction 


In order to model and process the information with uncertainty, many 
theories have been developed, such as probability theory (Lee, 1980), fuzzy 
set theory (Zadeh, 1965), Dempster-Shafer evidence theory (evidence the- 
ory) (Dempster, 1967; Shafer, 1976), rough set theory (Pawlak, 1982), and 
Z-numbers (Zadeh, 2011), which have been further used in various fields, such 
as information fusion (Lai, Chang, Ang, & Cheong, 2020; Pan, Zhang, Wu, & 
Skibniewski, 2020), risk assessment (X. Gao, Su, Qian, & Pan, 2021; Wang, 
Abdin, Fang, & Zio, 2021; Wang, Fang, & Zio, 2021), game theory (Baba- 
janyan, Allahverdyan, & Cheong, 2020; Cheong, Koh, & Jones, 2019), fault 
diagnosis (X. Chen, Wang, Ying, & Cao, 2021; Huang et al., 2021; Wang, 
Liu, Zhao, Guo, & Terzijae, 2020; Wang, Wei, et al., 2020), complex networks 
(T. Wen & Cheong, 2021), target recognition (Z. Wen, Liu, Zhang, & Pan, 
2021; Xiao, 2021), classification (Liu, Huang, Zhou, & Denoeux, 2021; Liu, 
Zhang, Niu, & Dezert, 2021) and decision making (Xie, Xiao, & Pedrycz, 2021). 

Set theory is a fundamental theory, which provides a basis for most existing 
theories (Jech, 2013). For example, the sample space of probability theory is 
the set that contains all the possible outcomes of a certain experiment (Lee, 
1980). In Dempster-Shafer evidence theory, the power set considers all the 
possible subsets of a frame of discernment (Dempster, 1967; Shafer, 1976). 

Recently, Song and Deng (2021) pointed out that a power set can be viewed 
as all the possible combination of the elements in a frame of discernment. A 
straightforward question is: “what a set would be if it not consider all the 
combinations of elements but all the permutations of elements in the frame 
of discernment?” To solve this problem, Y. Deng (2021) proposed a new type 
of set, called Random permutation set (RPS), which consists of permutation 
event space (PES) and permutation mass function (PMF). The PES of a cer- 
tain set considers all the permutations of that set. PMF describes the chance 
that a certain element in PES would happen. 

As is an efficient tool for deal with uncertainty, lots of information entropy 
have been proposed, such as Shannon entropy (Shannon, 1948), Tsallis entropy 
(Tsallis, 1988; Xue & Deng, 2021b), and Deng entropy (Y. Deng, 2020b; Xue & 
Deng, 2021a). Also, entropy has a wide variety of applications, including effect 
algebras (Di Nola, Dvureéenskij, Hy¢ko, & Manara, 2005), data fusion (Xiao, 
2019), decision making (Xiao, 2020), and uncertainty measurements (Q. Gao, 
Wen, & Deng, 2021; Xue & Deng, 2021a; Zhou & Deng, 2021). For measuring 
the uncertainty of RPS, L. Chen and Deng (2021) presented the entropy of 
RPS, which is compatible with Deng entropy and Shannon entropy. 

The maximum entropy principle states that the distribution with maximal 
entropy best represents the current state of a system based on given infor- 
mation, which is widely used in many fields, such as negation transformation 
(Wu, Deng, & Xiong, 2021; Yager, 2014), imprecise side-conditions (Buckley, 
2005), fuzzy cognitive maps (Feng, Lu, Pedrycz, Yang, & Liu, 2019), decision 
making (Yager, 2009), and uncertainty theory (Ma, 2021). As for the maxi- 
mum entropy principle of RPS entropy, two aspects should be handled. The 
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first one would be, “what is the maximum form for the entropy of RPS?” The 
second one would be, “what is the PMF condition for the maximum entropy 
of RPS?” 

To address these issues, in this paper, the maximum entropy of RPS is 
presented. The analytical solution for maximum entropy of RPS and its corre- 
sponding PMF condition are respectively proofed and discussed. In addition, 
numerical examples are used to illustrate the maximum entropy RPS. The 
results show that the maximum entropy RPS is compatible with the maxi- 
mum Deng entropy and the maximum Shannon entropy. When the order of 
the element in permutation event is ignored, the maximum entropy of RPS will 
degenerate into the maximum Deng entropy. When each permutation event 
is limited to containing just one element, the maximum entropy of RPS will 
degenerate into the maximum Shannon entropy. 

The rest of this article is as follows. Section 2 introduces the preliminaries. 
Section 3 presents the maximum entropy of RPS. Section 4 uses some numerical 
examples to illustrated the maximum entropy of RPS. Section 5 makes a brief 
conclusion. 


2 Preliminaries 


In this section, we briefly review some preliminaries of this paper. 


2.1 Dempster-Shafer evidence theory 


Dempster-Shafer evidence theory (Dempster, 1967; Shafer, 1976) is an 
efficient tool for dealing with uncertainty (Y. Deng, 2020b). 


Definition 2.1 (Frame of discernment). Let ©, called the frame of discern- 
ment (FOD), denotes a fixed set of N mutually exclusive and exhaustive 
elements, indicated by © = {61,02,...,9n}. The power set of ©, denoted as 
2°, contains all possible subsets of © and has 2% elements. 29 is indicated by 
2° = {2, {01} {On}, {81,02} {91 0N} , O}. 


Definition 2.2 (Mass function). Given a FOD of ©, a mass function is a 
mapping function defined by m : 2° — [0,1], which is constrained by m(0) = 0 
and X, m(A)=1. 


AE29 


2.2 Deng entropy and maximum Deng entropy 


In order to measure the uncertainty of mass function in evidence the- 
ory, a novel entropy, called Deng entropy, also named as belief entropy, is 
proposed (Y. Deng, 2020b), which is further generalized into information 
volume (J. Deng & Deng, 2021; Y. Deng, 2020a; Q. Gao et al., 2021). 
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Definition 2.3 (Deng entropy). Given a certain mass function distribution 
defined on FOD ©, Deng entropy is defined as: 


m(A) 


Hpn(m) =- > m(A)log(sq—) (1) 


|A] — 
AE29 2 1 


where |A| is the cardinal of a certain focal element A. 


The maximum entropy is an important conception in statistic. The analyt- 
ical solution of the maximum Deng entropy and its corresponding condition 
are given as follows (Y. Deng, 2020b). 


Theorem 1 (The mass function condition of maximum Deng entropy). Let 
the frame of discernment be O. The maximum Deng entropy appears if and 
only if the mass function distribution satisfies 


ala) 
ae eC mae 


2° (2) 


m( 


Theorem 2 (The analytic solution of maximum Deng entropy). The analytical 
solution of maximum Deng entropy is that 


Amax-DE = log 5 a = 1) (3) 
A€2° 


2.3 Random permutation set 


In 2021, Y. Deng (2021) proposed Random permutation set (RPS), which 
is a novel set consisting of permutation event space (PES) and permutation 
mass function (PMF). Some basic definitions of RPS are given as follows. 


Definition 2.4 (Permutation event space). Given a fixed set of N mutu- 
ally exclusive and exhaustive elements O = {01,02,...,9n}, its permutation 
event space (PES) is a set of all possible permutations of © defined as 
follows: 


PES (O) ={ Ay |i = 0, ..., N; j = Lay PO) (4) 
={ 0, (81) ; (82) pees (0n) ; (81, 62) > (02, 01) EEEE (0N-1, On) > 
(ON, ON—1) 5-05 (O15 02, «25 ON) 5 +5 (ON, ON—1, +501) } 5) 


in which P(N, i) is the i-permutation of N defined as P(N,i) = AE The 
element Aij in PES is called the permutation event, which is a tuple rep- 
resenting a possible permutation of ©, where i indicates the index for the 


cardinality of Aij and j denotes the index for the possible permutation. 


Springer Nature 2021 TeX template 


Maximum Entropy of Random Permutation Set 5 


Definition 2.5 (Random permutation set). Given a fixed set of N mutu- 
ally exclusive and exhaustive elements © = {01,02,...,0N}, its random 
permutation set (RPS) is a set of pairs defined as follows: 


RPS (©) = {(A,.a@(A)) | A € PES (®)} (6) 


where M is called the permutation mass function (PMF), which is 
defined as: 

M : PES(®) —> [0,1] (7) 
constrained by M (0) =0 and X` acpes(o) M (A) =1 


2.4 Entropy of random permutation set 


For modeling the uncertainty of the RPS, L. Chen and Deng (2021) 
presented the entropy of random permutation. 


Definition 2.6 (Entropy of random permutation set). Let a RPS be 
denoted as RPS (O) = { (Aij, M (Aij)) |Aij E PES (©)}, which is defined on 
PES (O) = {Aj; li = 0, ..., N; j = 1,..., P (N,i)}. The entropy of this RPS is 
defined as: 


P(N,i) 7 
Hrps(@ =-->) M (Aij) log (2) (8) 


i=1 j=l 


where P(N,i) = Wo is the i-permutation of N and F (i) = ar P (i,k) = 


ys wm is the sum from 0-permutation of i to i-permutation of i. 


3 Maximum entropy of random permutation set 


In this section, the maximum entropy of RPS as well as its PMF condition 
are respectively presented and proofed. 


3.1 The PMF condition for maximum entropy of RPS 
Let the PES be PES (O) = {A |i =0,...,N; j =1,. ip P(N, i) 
be as ti PIN) = aw EOI and F (i) be defined as F (i he Sro l= 


5i k=0 -KJI iy . The PMF condition for maximum entropy of RPS is presented 
as follows. 


Theorem 3 (The PMF condition for maximum entropy of RPS). The maz- 
imum entropy of RPS happens if and only if the PMF satisfies the following 
condition 


F(i)-1 


a wh (P(N, i) (F) - 1) 


(9) 
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Proof 3.1 (Proof for Theorem 3). Let the entropy of RPS be denoted as 


N P(N,i) 


M (Aij 
H(M)=-X X (Ajj) log, (4a) (10) 
i=1 j=l 
which is contrained by 
M (Aij) =1 (11) 
AijEPES(O) 


where b is the base of logarithmic function. Then the Lagrange function with 
Lagrangian multiplier A can be defined as follows: 


H(m=->> > Masio (4 a) +X XO M(Aiz) -1 
i=1 j=l AijEPES(O) 
(12) 


In order to get the maximum of H (M), the gradient of Ho (M) should be 
equal to 0. Hence, the gradient can be deduced as follows: 


A 


OMA) 
Based on Eq. (13), it can be concluded that, with respect to different i € 


{1,2,...,N} and j € {1,2,..., P(N, i}, a) is a constant denoted as C: 


Ca. = (14) 


N P(N,?2) N P(N,) 
Yo A&A) = M(Ax)=>> X C#[F@-] 
AijEPES(O) i=1 j=1 i=1 j=1 
N 
= J [P (N,i)* C + (F G) — 1)] =1 (15) 


so that C can be calculated as 


1 
C= 16 
Dia (P(N, 4) (F @ - 0) m 
Based on Eq. (14) and Eq. (16), we can get this equation: 
M (Aij) _ 1 
FO-117 SL PNJ FO- a 
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Therefore, the condition for maximum entropy of RPS can be obtained: 
F(i)-1 


(18) 
Diet P(N, 8) (F @— 2) 


M (Ajj) = 


3.2 The analytic solution for maximum entropy of RPS 
Let P(N, i) be as follows P(N, i) = ROI and F (i) be defined as F (i) = 


an P (i,k) =D Ie The analytical solution for the maximum entropy 
of RPS is detailed as follows. 


Theorem 4 (The analytic solution for maximum entropy of RPS). The 
analytical solution for maximum entropy of RPS is that 


N 
Amax-RPS = log (>: [P (N, i) (F (i) > n) (19) 


Proof 3.2 (Proof for Theorem 4). According to Theorem 3, the maximum 
entropy of RPS happens when PMF satisfies Eq. (18). Hence, the analytic solu- 
tion for maximum entropy of RPS can be calculated by substituting Eq. (18) 
into Eq. (8): 


Hmax-RPS = — oy f u ee ( : )} 
E = PND EFA- (OX PW) (i) - DI 
(20) 


For a certain PES, N is a constant, so that DDA [P (N,i) (F (i) — 1)] is also 
a constant. Therefore, Eq. (20) can be calculated as: 


tog ( y PEO) x 
ial : F(i)-1 21 
E [P (N, i) (F (i) — 1)] > = AE i 


log (Di [P (Ni) (F (®) - 1) 
P(N,i)(F(i)-1 22 
Ei [P (N, i) (F @ - 1] 2 [P P ) 


N 
= log (>: [P (N, i) (F (i) — ni) 23) 


i=1 
As a result, the analytic solution for maximum entropy of RPS is obtained. 


Hmax-RPS = 


4 Numerical examples and discussions 


In this section, some numerical examples are shown to illustrate the 
presented maximum entropy of RPS and its PMF condition. 
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Example 4.1. Assume there are three balls in a box, whose colors are red, 


blue, and green, respectively. With respect to different colors, these 


balls in the 


box can be denoted by {R, B,G}. Then, we take the following actions: 


Action 1: Randomly take out one ball from the box. 


Action 2: Randomly take out a number of balls from the box without 


replacement. 


Action 3: Randomly take out a number of balls from the box in sequence 


without replacement. 


® 
® © 
I 
Action f Action 2 Action 3 
O={R,B,G) 921R, B, G} PES ({R,B,G}) 
0 ||®@||@| |@ 9 ||®@| | ®@| |@ 
® ® ®| 00 0O ®® |®@||\®@ 
o o [9 00| [00] [00 
® © 
M00 00O 00O 
O00 000A 00O 


Fig. 1: The illustration for all the possible results based on Action 1 to 3 


All the possible results of the three actions can be respectively repre- 


sented by sample space O, power set 21®-B:C}, and permutation 
PES({R, B,G}), which are illustrated in Figure 1 and detailed as 


© = {R,B,G} 


yee { 0, {R}, {B}, {G}, 
{R, B}, {R, G}, {B,G}, {R, B,G} } 


PES ({R, B, G}) = { 0, (R) , (B) , (G), 
(R, B), (R,G),(B,G), 
(B, R), (G, R) , (G, B), 
(R, B,G), (R, G, B), (B, R,G), 
(B.G, R). (G, B, R), (G, R, B) } 


event space 
follows: 


(24) 


(25) 


(26) 
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Based on ©, 2488:G}, and PES ({R,B,G}), the probability condition for 
maximum Shannon entropy (Shannon, 1948), the mass function condition 
for mazimum Deng entropy (Y. Deng, 2020b), and the PMF condition for 
maximum entropy of RPS can be respectively obtained: 


P: P({R}) = P({B}) = P({G}) = 0.3333. (27) 
m: m({R}) =m ({B}) = m ({G}) = 0.0526; (28) 
m({R, B}) =m({R, G}) = m ({B, G}) = 0.1579; 
m({R, B, G}) = 0.3684. 


M: M (R) = M (B) = M (G) = 0.0085; (29) 
M (R, B) = M (R,G) = M (B,G) 
= M (B, R) = M (G, R) = M (G, B) = 0.0342; 
M (R, B,G) = M (R,G, B) = M (B,R,G) 
= M (B,G, R) = M (G, B, R) = M (G, R, B) = 0.1282. 


This example illustrate the PMF condition for maximum entropy of RPS. 
It can be seen in Eq. (29) that, with respect to the same cardinality of per- 
mutation event, the PMFs for that permutation events have the same value. 
For example, the permutation events (R), (B), (G) are of the same value of 
cardinality. Their corresponding PMFs are the same, which is 0.0085. In addi- 
tion, according to Eq. (29), the larger the cardinality of a certain permutation 
event, the larger the corresponding PMF is. 


Example 4.2. Let a set of N mutually exclusive and exhaustive elements 
be denoted by © = {61,02,...,A9n}. Based on ©, the sample space of maz- 
imum Shannon entropy, the power set of maximum Deng entropy, and the 
PES of maximum entropy of RPS can be respectively indicated by O, 2°, and 
PES(®). Hence, their corresponding maximum Shannon entropy Hmax-sE; 
maximum Deng entropy Hmax-pE, and maximum entropy of RPS Hmax-RPS 
can be obtained: 


Aymax-SE = logs (N) , (30) 
Hmax-DE = logs 5 (2!4l = ») , (31) 
AE2° 
N 
Hmax-RPS = logs (>: [P (N, i) (F (2) = n) ` (32) 
i=l 


With different value of N, the value of Hmax-se, Hmax-pg, and Hmax-RPS 
can be calculated, which are shown in Table 1 and Figure 2. 


This example shows that the trend of the maximum entropy of RPS chang- 
ing with different value of N. In addition, according to Figure 2, with respect 
to the same value of N, the value of maximum entropy of RPS is larger than 
that of maximum Shannon entropy or maximum Deng entropy. This means 
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Table 1: Maximum Shannon entropy, maximum Deng entropy, and 
maximum entropy of RPS with different N 


N Amax-SE Hmax-DE Hmax-RPS 
1 0.0000 0.0000 0.0000 
2 1.0000 2.3219 3.3219 
3 1.5850 4.2479 6.8704 
4 2.0000 6.0224 10.9278 
5 2.3219 7.7211 15.5406 
6 2.5850 9.3772 20.6691 
7 2.8074 11.0077 26.2495 
8 3.0000 12.6223 32.2231 
9 3.1699 14.2266 38.5424 
10 3.3219 15.8244 45.1699 


Note: the logarithm is based on 2. 


50.0000 

ks 45.0000 
40.0000 
35.0000 
30.0000 
25.0000 
20.0000 
15.0000 
10.0000 
5.0000 
0.0000 


==@— H_max-SE 
p 
Z —=@=— H_max-DE 


== H_max-RPS 


Value of different maximum ent 


123 4 5 6 7 8 9 10 
Value of N 


Fig. 2: The trend of maximum Shannon entropy, maximum Deng entropy, 
and maximum entropy of RPS with different N 


that, with respect to the same number of samples of a certain set, the uncer- 
tainty of a RPS is larger than that of a power set or a sample space, since RPS 
takes permutation of a certain set into account while sample space and power 
set do not consider that. 


Example 4.3. Given a fired set of N mutually exclusive and exhaustive 
elements O = {X,Y}, its corresponding PES is that 
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Based on this PES, the maximum entropy of RPS is calculated by: 


i=l 
= log, [2 * (1 +1 — 1) +2*(1+2+42-1)] = 3.3219 


Amax -RPS = logs (>: [P (2, i) (F (i) _ n) (34) 


in which F(t) is defined as F (i) = aa P(i,k). 
Consider the following two scenarios: 


e According to Y. Deng (2021), if the order of the element in PES(O) 
is ignored, PES(®) will degenerate into the power set: 29 = 
10, {X}, {1Y}, {X,Y }}. Based on this power set, calculate the maximum 
Deng entropy 


Hmax-DE = logs ( 5 (214l = n) (35) 


AE29 
= logy [2 * (2t — 1) +1 (2? — 1)] = 2.3219 (36) 


Besides, since the order of the element is ignored, the permutation num- 
ber P(N,i) degenerates into combinatorial number C(N,i), and F (i) should 
be calculated as F(i) = 3°.) C (i,k). Hence, the corresponding maximum 
entropy of RPS in this scenario can be detailed by: 


max -RPS = logs [C (2, 1) (F (1) > 1) + C (2, 2) (F (2) _ 1)] (37) 
= log, 2404 1—1)4140 4241-1] = 2.3219 


which is the same as Hmax-pE. As a result, if the order of the element 
in PES is ignored, the maximum entropy of RPS will degenerate into the 
maximum Deng entropy. 

According to Y. Deng (2021), if each permutation event is limited to con- 
taining just one element, PES(©) will degenerate into the sample space in 
probability theory: Q = {{X}, {Y}}. Based on this sample space, calculate 
the maximum Shannon entropy: 


Hias -SE = logs (2) = 1 (38) 


Additionally, since permutation event is limited to containing just one 
element, the permutation number P(N,i) degenerates into 


1 (i=0,N > 1) 
P(N, N (i=1,N>1) (39) 
0 (otherwise) 
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so that F'(1) should be calculated as F(t) = ys P(i,k) =i+1. Hence, the 
corresponding maximum entropy of RPS in this scenario is that: 


Hynax-rps = log, [P (2,1) * (F (1) -1) + P(2,2)*(F@)-D] (40) 
= log, [2* (1+1—1)+0*(2+1-1)|=1 


which is the same as Hmax-se. As a result, if each permutation event 
is limited to containing just one element, the maximum entropy of RPS 
degenerates into the maximum Shannon entropy. 


This example shows that the maximum entropy RPS is compatible with 
the maximum Deng entropy and the maximum Shannon entropy. 


5 Conclusion 


Recently, Random permutation set (RPS) is proposed, which is a new kind 
of set considering all the permutation of elements in a certain set. The entropy 
of RPS is further presented for modeling the uncertainty of RPS. However, the 
maximum entropy principle of RPS entropy has not been discussed. To address 
this issue, in this paper, the maximum entropy of RPS is presented. The main 
contributions of this paper and some remarks on the maximum entropy of RPS 
are summarized as follows: 


e The analytical solution for maximum entropy of RPS and its PMF condition 
are respectively presented and proofed. 

e Numerical examples are used to illustrate the maximum entropy RPS. 
The results show that the maximum entropy RPS is compatible with the 
maximum Deng entropy and the maximum Shannon entropy. 

e When the order of the element in permutation event is ignored, the max- 
imum entropy of RPS will degenerate into the maximum Deng entropy. 
When each permutation event is limited to containing just one element, 
the maximum entropy of RPS will degenerate into the maximum Shannon 
entropy. 
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